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Abstract 

We measure the three-point correlation function (3PCF) of the SDSS DR7 main sample galaxies 
in both redshift and projected spaces on scales up to 40ft.~^Mpc. The dependence of the 3PCF 
on stellar mass and color is explored in different scales and triangle shapes. We find a weak but 
significant stellar mass dependence. More massive galaxies generally have higher amplitudes of the 
3PCF. but lower amplitudes of the reduced 3PCF. The reduced 3PCF in both redshift and projected 
spaces only has mild shape dependence on small scales (< 2ft,~^Mpc), regardless of stellar mass and 
color. The shape dependence of the reduced 3PCF does not correlate with the stellar mass on small 
scales. On large scales, the shape dependence of the reduced 3PCF is stronger for lower-mass galaxies. 
The reduced 3PCF in the projected space shows weaker shape dependence but stronger stellar mass 
and color dependence, indicating that the redshift-space distortion reduces the dependence on galaxy 
properties. Red galaxies have higher amplitudes of the reduced 3PCF than those of the blue galaxies, 
implying that the nonlinear bias is important for the dependence on color. 

Subject headings: galaxies: statistics , cosmology: observations , large-scale structure of Universe 



1. INTRODUCTION 

In the current paradigm of galaxy formation within a 
merging hierarchy of dark matter halos, galaxies form 
when gas is able to cool, condense and form stars at the 
centers of dark halos (White & Rees 1978). Galaxy for- 
mation thus involves complicated byronic processes that 
play crucial roles on galaxy and cluster scales but are 
poorly understood in many aspects. The situation is 
more complicated considering that the galaxy distribu- 
tion is biased relative to the dark matter distribution and 
such biasing depends strongly on both spatial scale and 
galaxy properties (see e.g.. Kaiser 1984; Bardeen et al. 
1986). Studies of the galaxy distribution are expected to 
provide powerful constraints on models of galaxy forma- 
tion and evolution. 

It is common to use the two-point correlation func- 
tion (2PCF) ^(r) to quantify the galaxy clustering 
in both theories and galaxy surveys (Davis & Geller 
1976; Groth & Peebles 1977; Davis et al. 1985, 1988; 
Hamilton 1988; White et al. 1988; Boerner et al. 
1989; Einasto 1991; Park et al. 1994; Loveday et al. 
1995; Benoist et al. 1996; Guzzo et al. 1997; 
Beisbart & Kerscher 2000; Norberg et al. 2001; 
Zehavi et al. 2002, 2005, 2011; Li et al. 2006a, 2007; 
Skibba et al. 2006; Wang et al. 2007; Zheng et al. 2007; 
Swanson et al. 2008; Guo et al. 2013). The next or- 
der statistics in the hierarchy of iV-point correlation 
functions, the three-point correlation function (3PCF) 
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C(''ij ''2, ''3)7 is nevertheless not negligible. Because 
it is the lowest order to quantify the non-Gaussian 
features in the universe, which naturally arise in the 
nonlinear evolution of density fluctuation even in an 
initially Gaussian distributed density field (see e.g., 
Bernardeau et al. 2002). Although we generally as- 
sume a Gaussian primordial density field, which is 
completely described by the 2PCF, the 3PCF is also 
important when we want to characterize the primordial 
non-Gaussianity (Sefusatti & Komatsu 2007), e.g., in 
the comic microwave background (CMB) observations 
(Liguori et al. 2006, 2010; Komatsu et al. 2011). 

Similar to the 2PCF, which measures the excess of 
galaxy pair counts over the random distribution, the 
3PGF calculates the excess probability of triplets in the 
universe. So precise determination of the 3PCF requires 
a much larger galaxy sample. Meanwhile, since the 
number of triplets scales as , the measurement of the 
3PGF is computationally more difficult. Consequently, 
while the dependence of the 2PCF on galaxy properties 
(such as luminosity, color and stellar mass) has been 
investigated extensively in literature (e.g., Zehavi et al. 
2005, 2011; Li et al. 2006a; Meneux et al. 2008; 
Guo et al. 2013), the observational research on the simi- 
lar dependence in 3PCF is still in slow progress. Many 
previous works using the observational data to measure 
the 3PCF or its Fourier-space counterpart, the bispec- 
trum, put their focus on the constraints of galaxy biasing 
(Gaztanaga & Frieman 1994; Scoccimarro et al. 2001; 
Verde et al. 2002; Jing & Borner 2004; Gaztanaga et al. 
2005; Nishimichi et al. 2007; Guo & Jing 2009a; 
McBride et al. 2011b). 

Instead of directly studying the 3PCF, it is gen- 
erally more convenient to define the reduced 3PCF, 
(5(ri, r2, rs), as the ratio between the 3PCF C(''1j ''2, ''a) 
and the sum of the products of the 2PCFs. Such 
hierarchical scaling (^ cx ^^) was introduced by 
Groth & Peebles (1977) assuming Q to be a constant. 
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Although the following theories and observations found 
that Q is generally dependent on the size and shape of 
the triangle (ri,r2,r3) (see e.g., Bernardeau et al. 2002), 
it is still more natural to use Q as the measurement of 
non-Gaussianity generated from gravitational clustering. 
The 3PCF itself is of less interest in view of hierarchical 
clustering as we can now precisely measure the 2PCF. 

In observation, the redshift-space distortion (RSD) ef- 
fect will significantly change the shape and amplitude 
of both 2PCF and 3PCF, because galaxy peculiar ve- 
locities prevent us from measuring the real radial distri- 
bution of the galaxies. On small scales, the RSD will 
make the galaxy distribution stretched along the line 
of sight, known as the "Fingers-of-God" effect (Jackson 
1972). On large scales, the structures in redshift space 
will be squashed along the line of sight by the large- 
scale infall, which is often referred to as the Kaiser ef- 
fect (Kaiser 1987). Projected correlation function is then 
used to minimize the influence of the RSD and it can 
be easily converted to the real-space correlation function 
(Davis et al. 1985). So the projected 3-point correlation 
function was proposed to the 3PCF in the real-space. 
Jing & Borner (1998) applied this statistic to the Las 
Campanas galaxy redshift survey. 

Jing & Borner (2004) used the Two-Degree Field 
Galaxy Redshift Survey (2dFGRS; CoUess et al. 2001) 
to measure the luminosity dependence of Q both in red- 
shift and projected spaces. They found a small but sig- 
nificant trend that more luminous galaxies have lower 
amplitudes of Q. Gaztafiaga et al. (2005) also measured 
the redshift-space Q with 2dFGRS and found a weak ten- 
dency for Q to decrease with increasing luminosity in the 
nonlinear regime. Kayo et al. (2004) and Nichol et al. 
(2006) employed the early data release (EDR) of the 
Sloan Digital Sky Survey (SDSS; York et al. 2000) and 
found no significant dependence of Q on galaxy mor- 
phology, color, or luminosity. Considering the mea- 
surement errors, their results are statistically consistent 
with Jing & Borner (2004) and Gaztafiaga et al. (2005). 
Apart from the analysis of the observational data, an- 
other way to study the RSD is using numerical simula- 
tions (e.g., Gaztafiaga & Scoccimarro 2005; Marfn ct al. 
2008). Marin et al. (2008) used A^-body simulations to 
construct mock galaxy catalogs and compared Q in real 
and redshift spaces. They also found the same luminosity 
dependence of Q as in the observation and they argued 
that the color dependence of Q appears stronger than 
the luminosity dependence, which is consistent with the 
finding of Gaztafiaga et al. (2005). 

Recently, McBride et al. (2011a) explored the depen- 
dence of Q on luminosity and color in redshift and pro- 
jected spaces using SDSS DR6. They measured the re- 
duced 3PCF at 3-27 ft.~^Mpc and compared the lumi- 
nosity dependence for galaxies of r-band absolute mag- 
nitude Mr < —19.5. They found similar luminosity and 
color dependence to the previous works and inferred that 
the weak configuration dependence of Q on small scales 
is caused by the RSD. They also used these measure- 
ments to infer the galaxy bias and found the linear bias 
model to better agree with the current constraints on ag 
(McBride et al. 2011b). 

In this paper, we will use the final release data (DR7; 
Abazajian ct al. 2009) of SDSS to measure the 3PCF in 
both redshift and projected spaces following the work 



of Jing & Borner (2004). Different to the previous re- 
sults, we will investigate the luminosity, color as well as 
the stellar mass dependence, considering the importance 
of stellar mass as a more physical parameter of galax- 
ies (Li et al. 2006a; Li & White 2009). Since the stellar 
mass dependence of the 3PCF has never been studied 
before, it will provide more constraints on the current 
galaxy formation models. We extend the previous anal- 
ysis by exploring galaxy samples to a broader range of 
luminosity and scales and we investigate more triangle 
configurations to identify whether the weak configura- 
tion dependence of Q is really caused by the RSD. 

The paper is constructed as follows. In Section 2, we 
briefiy describe the galaxy and mock samples. The meth- 
ods of measuring the 2PCF and 3PCF are presented in 
Section 3. We present our results of the stellar mass, lu- 
minosity and color dependence of the 3PCF in Section 4. 
Wc summarize our results in Section 5. 

Throughout this paper we assume a cosmology model 
with the density parameter fi^ = 0.3 and the cos- 
mological constant J^a = 0.7, and a Hubble constant 
Ho = lOO/ikms-^Mpc-i with h = 1.0. 

2. DATA 
2.1. SDSS galaxy samples 

The galaxy sample used in this paper is a 
magnitude-limited sample taken from the New York 
University Value-Added Galaxy Catalog (NYU-VAGC), 
constructed by Blanton ct al. (2005) based on SDSS 
DR7. This sample has formed the basis for the recent 
studies on the galaxy distribution in the low-redshift uni- 
verse (e.g., Li et al. 2012a,b, 2013). The sample contains 
about half a million galaxies located in the main contigu- 
ous area of the survey in the Northern Galactic Cap, with 
r < 17.6, —24 < Mr < —16, and spectroscopically mea- 
sured redshifts in the range of 0.001 < z < 0.5. Here r is 
the r-band Petrosian apparent magnitude, corrected for 
Galactic extinction, and Mr is the r-band Petrosian abso- 
lute magnitude, corrected for evolution and if-corrected 
to z = 0.1. The apparent magnitude limit is chosen to 
select a sample that is uniform and complete over the 
entire area of the survey (see Tegmark et al. 2004). The 
median redshift of this sample is z = 0.088, with 10% of 
the galaxies below z=0.033 and 10% above z=0.16. 

The stellar mass of each galaxy in our sample accom- 
panies the NYU-VAGC release. It is estimated based 
on the redshift and the five-band Petrosian magnitudes 
from SDSS photometric data, as described in detail in 
Blanton & Roweis (2007). This estimate corrects implic- 
itly for dust and assumes a universal stellar initial mass 
function (IMF) of Chabrier (2003) form. As demon- 
strated in Appendix A of Li & White (2009), once all 
estimates are adapted to assume the same IMF, the esti- 
mated stellar masses agree quite well with those obtained 
from the simple, single-color estimator of Bell et al. 
(2003) and also with those derived by Kauffmann et al. 
(2003) from a combination of SDSS photometry and 
spectroscopy. 

From this sample we select two sets of samples accord- 
ing to either r-band absolute magnitude (Mr) or stellar 
mass {logiQ AIs). In each of these samples, we further 
divide the galaxies into red and blue populations accord- 
ing their g — r color, following the luminosity-dependent 
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color divider determined in Li et al. (2006a). Details of 
the luniinosity-/niass-selected samples, as well as their 
red/blue samples, are listed in Table 1. 

2.2. Random samples 

To obtain reliable estimates of the auto-correlation 
functions, each observed sample in Table 1 must be 
compared with a "random sample" which is unclus- 
tered but fills the same region of the sky and has 
the same, position-dependent spectroscopic completeness 
and luminosity-dependent redshift distribution. We con- 
struct our random samples from the observed samples 
themselves, as described in detail in Li et al. (2006a). For 
each real galaxy we generate 10 sky positions at random 
within the mask of the survey (see Blanton et al. 2005, 
for details), and we assign to each of them the prop- 
erties of the real galaxy, in particular, its values of red- 
shift, luminosity and stellar mass, as well as the position- 
dependent spectroscopic completeness. Extensive tests 
show that random samples constructed in this way pro- 
duce indistinguishable results from those using the tra- 
ditional method (Li et al. 2006b). 

2.3. Mock galaxy samples 

We construct a set of 80 mock SDSS galaxy catalogs 
from the Millennium Simulation (Springel et al. 2005) 
using both the sky mask and the magnitude and red- 
shift limits of our real SDSS sample. The Millennium 
Simulation uses 10^° particles to follow the dark matter 
distribution in a cubic region with 500/i~^Mpc on a side, 
assuming the concordance A cold dark matter cosmology. 
Galaxy formation within the evolving dark matter halos 
is simulated in postprocessing using semi-analytic meth- 
ods tuned to give a good representation of the observed 
low-redshift galaxy population. Our mock catalogs are 
based on the galaxy formation model of Croton et al. 
(2006) and are constructed from the publicly available 
data at z = using the methodology of Li et al. (2006b) 
and Li et al. (2007). These mock catalogs allow us to de- 
rive realistic error estimates for the correlation functions 
we measure, including both sampling and cosmic vari- 
ance uncertainties. We use all the 80 mock catalogs for 
estimating the errors of our two-point correlation func- 
tion measurements. For the three-point correlation func- 
tions, we use 10 mock catalogs randomly selected from 
the whole set, in order to save computational time while 
obtaining resonably good estimation of errors. 

3. CORRELATION FUNCTION MEASUREMENTS 

3.1. Two-point Correlation Function 

We begin by estimating the two-dimensional, redshift- 
space, two-point auto-correlation function for each of the 
samples listed in Table 1, C(''pj''7r), using the estimator 
of Landy & Szalay (1993): 



DD - 2DR + RR 
RR ' 



(1) 



where DD, DR and RR are the data-data, data-random 
and random-random pair counts, and rp and r^r are the 
pair separations perpendicular and parallel to the line 
of sight. To normalize appropriately, RR needs to be 
multiplied by {Ng/NrY and DR by Ng/Nr where Ng and 
Nr arc the numbers of galaxies in the real and random 



samples, respectively. In our case, iV^ = 10 x Ng. We 
have corrected the effect of fiber collisions in the same 
way as in Li et al. (2006b) and Li et al. (2007). Detailed 
tests of the method can be found in Li et al. (2006b) and 
Guo et al. (2012). 

Next, we integrate these two-dimensional correlation 
estimates over the line-of-sight separation r^, to obtain 
the projected auto-correlation function, Wp{rp), as fol- 
lows, 



Wp{rp) 



S,{rp,r^)dr^ ^ ^^{rp,r^)Ar 



(2) 

where we choose r-,^,max = 40/i ^Mpc as the outer limit 
for the integration depth (in order to reduce the noise 
from distant uncorrelated regions) so that the summation 
for computing Wp{rp) runs from r^r,! = — 39.5/i~^Mpc to 
f-n.so — 39.5/i~^Mpc, given that we use bins of width 
Ar^,j = l/i-^Mpc. 

In addition to Wp{rp), we also measure the one- 
dimensional auto-correlation function in redshift space, 
^(s), using the same estimator in Equation (1) but as a 
function of s, the redshift-space three-dimensional pair 
separation, which is given by 



(3) 



The measurements of Wp{rp) and ^(s) for the four 
luminosity-selected samples are presented in Figure 1. 
For clarity, we show the Wp{rp) errors only for the lu- 
minosity sample of —20 < Mr < —19, which are esti- 
mated from the 80 mock catalogs as described in the 
previous section. In all cases, both Wp{rp) and ^(s) 
show systematic trends with luminosity, reflecting the 
well known fact that more luminous galaxies are clus- 
tered more strongly. The projected two-point correlation 
function can be separated into two parts: a steeper inner 
part at pair separations below ~ l/i~^Mpc and a flatter 
outer part at larger separations. In the language of "halo 
model" (Cooray & Sheth 2002), the inner part is called 
one-halo term where the pair counts are mostly galaxy 
pairs in the same halo, and the outer part is called two- 
halo term where galaxy pairs are mostly from separate 
halos. The separation where the transition between the 
two terms occurs increases with increasing luminosity. In 
the two- halo term, the amplitude of Wp{rp) is an increas- 
ing function of luminosity, while its slope shows weak or 
no luminosity dependence. This is consistent with the 
picture that, on large scales, the bias in the galaxy dis- 
tribution is related in a simple way to the bias in the dis- 
tribution of dark halos. In contrast, the one-halo term is 
a strong increasing function of galaxy luminosity, in both 
amplitude and slope (see also, Zehavi et al. 2011). This 
indicates that galaxies of different luminosities are dis- 
tributed within their host halos in different ways. When 
compared to the projected correlation function, the ^(s) 
measurements are relatively suppressed on small scales, 
leading to almost no transition between the one-halo and 
two-halo terms. This is caused by the redshift distortion 
effect on small scales and the global infall towards high- 
density regions on large scales. 

Both the projected and redshift-space two-point cor- 
relation functions have been extensively studied in 
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TABLE 1 

Flux-limited samples of different luminosity and stellar mass 



Sample 


Mr 


Number of galaxies 


Red Galaxies 


Blue Galaxies 


LI 


[-19,-18) 


36223 


13127 


23096 


L2 


[-20,-19) 


107241 


52169 


55072 


L3 


[-21,-20) 


189880 


102128 


87752 


L4 


[-22,-21) 


118728 


73002 


45726 


Sample 


logioCMs/h^M©) 


Number of galaxies 


Red Galaxies 


Blue Galaxies 


Ml 


[9.0,9.5) 


32573 


6658 


25915 


M2 


[9.5,10) 


84024 


30700 


53324 


M3 


[10,10.5) 


181865 


97918 


83947 


M4 


[10.5,11) 


143235 


99932 


43303 



1000 



a, 



100 



1 1 

-22<M,<-21 

-Sl<M^<-20 
-20<M,<-19 
-19<M <-ia 




Tp [Mpc/h] 



100 




0.001 



100 



s [Mpc/h] 



Fig. 1. — Projected- (left panel) and rcdshift-space (right panel) two-point correlation functions for different luminosity samples. Lines 
of different color denote different luminosity samples, with the black, blue, green, and red for LI, L2, L3, and Li respectively. We only 
show the errors for one sample for clarity. 

literature using both SDSS-based samples (see e.g., 
Zehavi et al. 2005, 2011; Li et al. 2006a; Guo et al. 2013) 
and samples from other surveys. Our measurements are 
well consistent with those previous determinations (more 
detailed comparisons will be presented in a separate pa- 
per by Li et al.). In the current paper, these two-point 
autocorrelation measurements for different stellar mass, 
color and luminosity bins will be used in what follows to 
determine the reduced three-point correlation functions. 



The projected 3PCF n(rpi2, rp23, ''psi) and its re- 
duced counterpart (5p(rpi2, rp23, ?'p3i) are defined as 
(Jing & Borner 1998, 2004) 



n(rpi2,rp23,rp3i) = 

n(rpi2,rp23,?^p3i) 



'9p(''pl2,?'p23,''p3l) 



Wp{rpi2)wp{rp23) + eye 



(5) 
(6) 



3.2. Three-point Correlation Function 

By analogy with the case of 2PCF, if we want to define 
the 3PCF in the projected space, we need five free pa- 
rameters, (rpi2, rp23, rp3i, r^i2, r^23), where rpij and r-^ij 
are the separations of objects i and j perpendicular to 
and along the line of sight. The physical explanation of 
the 3PCF C{rpi2,rp23,rp3i,rTri2,rT,23) is the excess prob- 
ability of finding three objects simultaneously in three 
volume elements dVi, dV2, and dV^ at positions Si, S2 
and S3, excluding the contributions from the 2PCFs, 

dpi23 = n{si)n{s2)n{s,^) 

^[^ + £,{'rpi2,r^i2) + £,{rp23,r^23) + ^(''psi, J'ttSi) 

+C(''pl2, ''p23, 'rp31, ''7rl2, rT,23)\dVidV2dV3.. (4) 



Similarly, the redshift space reduced 3PCF is defined by, 

C(si2,S23,S3l) 



Qs(si2, S23, S31) 



(7) 



^(si2)C(s23) + cyc 

We use the following estimator to measure C and 11 in 
our samples (Szapudi & Szalay 1998), 

DDD - 3DDR + 3DRR - RRR 



c 



(8) 



RRR 

where DDD, DDR, DRR and RRR are the normalized 
number counts of triplets in each bin measured from data 
(represented by D) and random samples (represented by 
R). We set the maximum of integration over the line of 
sight as rT^^raax = 40 /i~^Mpc for both r7ri2 and 7'7r23- The 
binning of r-^ is defined as Ar^ = 1 /i~^Mpc. The choice 
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of Ar^ is important for the projected 3PCF because it 
is more sensitive to the spacial structure (McBride et ah 
2011a). 

Instead of using (ri,r2,r3) to represent the triangle, 
we use the parametrization of (ri,r2,0), with r2 > ri 
and 6 = arccos[(rJ + r| — r|)/2rir2]. We note that in 
this parametrization, one triangle is counted three times 
in different bins of (ri , r2 , 6*) . But it does not affect our 
measurements of the configuration dependence, once we 
do not combine the counts in different bins together. 
Following Jing & Borner (2004), we use the same log- 
arithmic binning for ri and r2, but linear binning for 
9 and tt. The choice of A9 is A9 = it/ 20, which is 
small enough to trace the dependence on 9. Unless a 
very large bin size (e.g., A9 = 7r/5) is used, decreasing 
the bin size of 9 in our samples does not improve the 
results but only reduce the signal-to- noise ratio (S/N) 
(Marin 2011). Considering the importance of binning 
scheme for the measurements of the three-point correla- 
tion function (see e.g., Gaztahaga & Scoccimarro 2005; 
Kulkarni et al. 2007; Marfn et al. 2008; McBride et al. 
2011a), we investigate the influence of the binning in 
ri and r2 on the reduced 3PCF in Figure 2. Without 
loss of generality, we present the results only for the 
galaxy sample of —21 < Mr < —20, which is the largest 
sample in luminosity. We require that f2 = 2fi and 
A log r2 = A log ri , where f i and f2 are the mean in log- 
arithmic space, i.e. the range of ri is log fi — A log ri/2 < 
logri < logfi -I- A log 7-1/2. Different lines in Figure 2 
represent different A log ri , with red, blue and black lines 
for Alogri = 0.05, 0.15 and 0.25, respectively. We only 
show the errors for the blue lines for clarity. For this test, 
the errors are calculated from the bootstrap resampling 
method (Jing & Borner 2004). 

We find that using larger bin sizes will generally reduce 
the amplitude of both and Qp, which is caused by 
the strong scale dependence of Q. The different bin sizes 
do not significantly affect the shapes of Qs and Qp. It 
seems to contradict the conclusions from McBride et al. 
(2011a) and Marfn (2011), who show that larger bins will 
smooth out the configuration dependence of Q. This is 
due to the fact that they measured the 3PCF in bins of 
ri, r2 and r^, with the bin- width Ar^ oc r^, i.e., logarith- 
mic bins in ri , r2 and r^. The binning scheme of ri and r2 
is similar to ours, but we measure the 3PCF in bins of ri, 
r2 and 9, and employ linear binning for 9. Using logarith- 
mic binning in leads to overlaps in neighboring bins of 
9 after the conversion from (ri, r2, ^3) to (ri, r2, 0). Such 
overlapping changes the shape dependence of Q. Figure 
2 shows that comparing the measurements of Q from 
different papers with different binning schemes does not 
make sense. In order to have a reasonable S/N, we use 
different Alogri on different scales, but the comparison 
of Q for galaxies with different properties are made under 
the same binning scheme. 

Another commonly-used parametrization of Q is 
{r,u,9), where r = ri, m = r2/ri and 9 is the an- 
gle between ri and r2 (e.g., Scoccimarro et al. 2001; 
Kayo et al. 2004; Nichol et al. 2006; Kulkarni et al. 2007; 
Guo & Jing 2009b). The definition is similar to ours, ex- 
cept for the replacement of r2 by m. Such parametrization 
is introduced to decompose the elements of the triangle 
into the scale (denoted by r) and shape (represented by 



u and 9) components. We note that in this parametriza- 
tion, A log r2 = A log ri -f A log u, which means that the 
bin- width of r2 is always larger than that of ri . Including 
u complicates the analysis, because we also need to take 
into account the bin-width of u. In order to have a small 
enough bin-width, we would rather use r2 instead of u 
and require that A log r2 = A log ri , which cannot be 
achieved with the parametrization of (r, u, 9). 

4. RESULTS 
4.1. Stellar Mass Dependence 

Without loss of generality, we show in Figure 3 the 
luminosity dependence of Qs and Qp for f2/fi = 2 in or- 
der to compare with results of previous works. Lines of 
different color denote different luminosity samples, with 
the black, blue, green, and red lines for LI, L2, L3, and 
LA, respectively (from faint samples to luminous ones). 
There is strong dependence of Q on luminosity, with 
more luminous galaxies showing lower Q, consistent with 
the findings of Jing & Borner (2004), Gaztanaga et al. 
(2005) and McBride et al. (2011a). 

We show in Figure 4 the stellar mass dependence of 
the redshift-space reduced 3PCF Qg. Lines of different 
colors denote samples of different stellar mass, with the 
black, blue, green, and red for Ml, M2, A/3, and MA, 
respectively. We only show the errors for one sample for 
clarity. Different panels present the results of Qs for dif- 
ferent scales and shapes. Generally, there is a trend that 
more massive galaxies have a lower amplitude of Qs. It is 
consistent with the finding that more luminous galaxies 
have a smaller Qs (Jing & Borner 2004; McBride et al. 
2011a), considering the strong correlation of stellar mass 
and luminosity. The two less massive samples, Ml and 
M2, have very similar amplitude of Qs on all scales, ex- 
cept for the largest scale on the bottom right panel. It 
indicates that these two samples have similar spacial dis- 
tribution on small scales. 

A way to characterize the dependence of 3PCF on stel- 
lar mass is to compare the 3PCF itself, (, rather than the 
reduced value Q. We show in Figure 5 the stellar mass 
dependence of ( for the case of f2 = 2fi. We find that 
more massive galaxies are clustered stronger than the less 
massive ones in the 3PCF, consistent with the results of 
2PCF (Li et al. 2006a). Such stellar mass dependence of 
C is contrary to the stellar mass dependence of Q, be- 
cause the stellar mass dependence of in Equation 7 is 
much stronger than that of the 3PCF. This can be under- 
stood from the larger galaxy bias of those more massive 
galaxies. In the second-order perturbation theory (see 
e.g., Bernardeau et al. 2002), the reduced 3PCF of the 
galaxies, Qg, is related to that of the underlying dark 
matter, Q„j, through 



where 61 and 62 are the linear and non-linear bias factors. 
If we only consider the linear bias model, i.e. 62 = 0, 
we find that a larger galaxy bias 61 would produce a 
smaller Qg. Although on small scales, the second-order 
perturbation theory fails because of the non-linear effects 
(Guo & Jing 2009b), and the galaxy bias factors become 
scale-dependent, it is still true that more massive galax- 
ies would show larger differences between the clustering 
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Fig. 2. — The influence of different Alogr'i bins for Qs and Qp. We present here the results of the galaxy sample with —21 < Air < —20 
and require r2 = 2ri and Alogr2 = Alogri. The fi and f2 values shown in the figure are the mean in logarithmic space, i.e. the range 
of ri is logfi — Alogri/2 < logri < logfi + Alogri/2. Different lines represent different Alogri, with red, blue and black lines for 
Alogr'i = 0.05, 0.15 and 0.25, respectively. We only show the errors for the blue lines for clarity. These errors are calculated from the 
bootstrap resampling method. 




Fig. 3. — Reduced 3PCF in rcdshift (upper panels) and projected spaces (bottom panels) at different scales and triangle shapes. They 
are only shown for the case of f2 = 2f i . Lines of different colors denote different luminosity samples, with the black, blue, green, and red 
for LI, L2, L3, and L4, respectively. We only show the errors for one sample for clarity. 
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Fig. 4. — Redshift-space reduced 3PCF Qs for different stellar mass samples at various scales and triangle shapes. Lines of different 
colors denote different stellar samples, with the black, blue, green, and red lines for A/1, M2, M3, and A/4 respectively. We only show the 
errors for one sample for clarity. 
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Fig. 5. — Three-point correlation function f for different stellar 
mass samples at various scales. The line styles are the same as in 
Figure 4. Only the case of f2 = 2fi is shown. 

strength of and C,. In the linear bias model, we can 
express the galaxy 2PCF as 

G = blU, (10) 

where is the 2PCF of the dark matter. Therefore, 
we have C ^ Qg^g ^ blQm£,m^ confirming that varies 
much stronger (oc 6f ) with different stellar mass samples 
than (. 

In the left panels of Figure 4, we find that Q is ap- 
proaching a constant on small scales (< 2 h~^Mpc), re- 
gardless of the stellar mass and shape. McBride et al. 
(2011a) measured Q on scales from 3/i^^Mpc to 
27 h~^ls/lpc, and found significant configuration depen- 
dence, which is not inconsistent with our results. In or- 
der to identify the correct scale of the triangle, we define 
the scale r^ax as the maximum of (ri, r2, r^). Our mea- 
surements on these small scales (< 2 h~^Mpc) show that 
the clustering hierarchy, C oc would be valid on scales 
of rmax < 2ft,~^Mpc. In principle, the clustering hier- 
archy implies that the higher-order iV-point connected 
correlation functions can be determined by only using 
the 2PCF and a set of constant hierarchical amplitudes 
Qn- 

Comparing Figures 4 and 5, we find that while ( de- 
creases with the scale, the scale dependence of Qs is 
two-sided. For elongated triangle shapes (0 ~ 0, and 
tt), Qs increases with scale, while for the perpendicular 
triangles(0 ~ tt/2), there is a weak trend for Qs to de- 
crease as the scale increases. These two effects make Qs 
show much stronger shape dependence on larger scales. 
On large scales, galaxies tend to be more clustered in 
linear structures, such as filaments (Scoccimarro et al. 
2001). Less massive galaxies have stronger shape de- 
pendence and are thus more populated in these linear 
structures. Since galaxies of different stellar mass gen- 
erally have different shapes of 2PCF (Li et al. 2006a), it 



is indeed expected to find the degeneracy of the stellar 
mass and shape dependence on large scales. 

The case ri = r2 for Qs is very special, because it 
shows a quite different configuration dependence as in 
other panels. With such triangles, the 3PCF can measure 
scales less than ri when < 7r/3. The maximum scale 
(fmax) of the triangle is ri. It seems that the configura- 
tion dependence of Qs shown in this way is determined 
by Tjnax of the triangle. If we define r^ax as the scale, we 
can use the angle Omax subtended by rmax as the config- 
uration 9. Therefore, the mild shape dependence of Qs 
seen in the top panels of Figure 4 when 6 < n/Sis caused 
by the fact that the 0max subtended by r^nax is only in 
the range of [7r/3,7r/2] where the variation of Qs with 
dmax is small. So the shape dependence of Qs is corre- 
lated with, but not determined by its scale dependence. 

We present the stellar mass dependence for the 
projected-space reduced 3PCF Qp in Figure 6. The re- 
sult of the sample Ml is not shown in the bottom right 
panel, because these low-mass galaxies only cover a small 
volume and the large-scale measurements would suffer 
from the cosmic variance effect. The stellar mass de- 
pendence of Qp is much stronger than that of Qg. From 
Equation (9), it implies that the RSD would significantly 
affect our determination of the galaxy bias and its rela- 
tion with the stellar mass, bi{Ms). We note that on small 
scales Qp is also close to a constant, similar to that of 
Qs. 

In Figure 7, we compare Qs and Qp for the sample 
of 10.0 < log(Ms) < 10.5. We find that Qp generally 
has weaker shape dependence than that of Qs, differ- 
ent from the conclusion of McBride et al. (2011a), who 
show that the projected-space Qp recovers more shape 
dependence that is lost to Qs due to RSD. It is possible 
that the shape dependence shown in their figures is some- 
what smoothed out by their choice of the parametrization 
(ri,r2,r3). Marm et al. (2008) compared the measure- 
ments of reduced 3PCF in real and redshift spaces for 
scales down to ri = 1.5 /i~^Mpc using the A^-body simu- 
lations. They found significant configuration dependence 
of Q in real space and concluded that the rcdshift-space 
distortions attenuate the shape dependence of Q. Since 
the projected correlation function is directly related to 
the real-space correlation function (Jing & Borner 2004), 
the weaker shape dependence of Qp means that the real- 
space Q should also have weaker shape dependence. The 
projection effect does not change the shape dependence, 
but only accumulate the signals along the line-of-sight. 
On small scales, the virial motions of galaxies within the 
halos dominate the galaxy distribution, and the RSD 
would introduce more shape dependence. It is reasonable 
to infer that the RSD produces more shape dependence 
along the line of sight, while the projected Qp would re- 
cover the correct signals at different directions. 

4.2. Color Dependence 

We show the color dependence of Qs and Qp for dif- 
ferent stellar mass samples in Figures 8 and 9. The red 
and blue lines are for the red and blue galaxies defined 
in Section 2. The results for all the galaxies in the stellar 
mass samples are also shown as the black lines. We only 
display the results for the case of f2/ri — 2. The dif- 
ferences between the 3PCFs of the red and blue galaxies 
are more apparent for less massive samples and on small 
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Fig. 6. — Same as in Figure 4, but for the projected-space reduced 3PCF i 
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Fig. 7. — Comparison of the scale and shape dependence of Qs 
(redshift space) and Qp (projected space) for the stellar mass sam- 
ple of 10.0 < log(Ms) < 10.5. The points arc for Qp and lines for 



scales. For the most massive galaxy sample in the right 
panels of Figures 8 and 9, there is only very weak de- 
pendence on color. Although in different stellar mass 
subsamples the fraction of red to blue galaxies varies a 



lot, it only affects the shot noise levels of the measure- 
ments of different color samples and should not change 
the color dependence of Q. 

Using high-resolution A'^-body simulations, 
Guo & Jing (2009b) demonstrate that the Equation 
(9) can be applied to measure the linear and nonlinear 
galaxy bias even on small scales where the second-order 
perturbation theory fails, although on small scales, the 
bias factors become scale-dependent. The red galaxies 
are found to have higher clustering amplitude than the 
blue galaxies in the 2PCF measurements (Zehavi et al. 
2005; Li et al. 2006a), i.e. red galaxies have larger 
galaxy bias bi. For linear bias models, we expect Q for 
red galaxies to be smaller than that for blue galaxies, 
which is contrary to the results in Figures 8 and 9. 
This implies that the linear bias model is not enough 
to describe the galaxy bias of different color samples, 
in which case the nonlinear bias factor 62 would not be 
negligible and plays an important role in Q. Considering 
that 61 and Q are both larger for red galaxies, we infer 
from Equation (9) that the nonlinear bias 62 of the red 
galaxies would also be larger than that of the blue ones. 

In 2PCF, the differences between the clustering 
strength of the red and blue galaxies become smaller 
in more luminous galaxy samples and on larger scales 
(Li et al. 2006a). We also find a similar trend in Q. In 
the bottom panels of Figures 8 and 9, Q for the red 
and blue galaxies are more similar on large scales and in 
more massive galaxy samples, implying that the galaxy 
bias factors would have less dependence on color for these 
cases. We note that for low mass samples, red galaxies 
have stronger shape dependence than the blue galaxies. 
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Fig. 8. — Redshift-space reduced 3PCF Qs for different color samples at different stellar mass and scales. The red and blue solid lines 
are for red and blue galaxies defined in Section 2. The results for all the galaxies in the stellar mass samples are also shown as the black 
lines for comparison. We only display the results for rilr\ = 2. 



especially on large scales. This indicates that the low- 
mass red galaxies are more influenced by the large-scale 
structure and preferentially populate in the linear struc- 
tures. 

5. CONCLUSIONS AND DISCUSSIONS 

In this paper, we measure stellar mass, color and 
luminosity dependence of the galaxy 3PCF using the 
SDSS DR7 main sample galaxies in the redshift range of 
0.001 < z < 0.5. We also investigate the scale and shape 
dependence of the 3PCF for samples of different stellar 
mass and color in both redshift and projected spaces. 

There is a weak but significant dependence of the re- 
duced 3PCF Q on galaxy stellar mass. More massive 
galaxies generally have higher amplitudes of the 3PCF 
C, but lower amplitudes of the reduced 3PCF Q, which 
is consistent with the finding that more luminous galax- 
ies have smaller Q (Jing & Borncr 2004; McBride et al. 
2011a). Such behavior of the 3PCF is related to the 



larger linear bias of more massive galaxies. The reduced 
3PCF is also dependent on the scale and shape of the 
triangle, which provides a measurement of spacial direc- 
tions in the galaxy distribution. Wc find that the shape 
dependence of Q is stronger on larger scales, reflecting 
the fact that the linear structures dominate the large- 
scale distribution. More massive galaxies show weaker 
shape dependence of Q, which is possibly resulting from 
the high occupancy of low-mass galaxies in the filamen- 
tary structures. The shape and scale dependence of Q 
is degenerate on large scales, and such degeneracy is not 
caused by the redshift distortion. The reduced 3PCF Qs 
in redshift space and Qp in projected space only have 
mild shape dependence on small scales (< 2/i~^Mpc), 
regardless of stellar mass. 

We investigate the color dependence of Q for different 
stellar mass samples. The color dependence is stronger 
for low-mass galaxies and on small scales, reflecting the 
different distribution of red and blue galaxies in the 
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Fig. 9. — Same as in Figure 8, but for the projected-space reduced 3PCF Qp. 



small-scale structures. The red galaxies have higher clus- 
tering amplitudes and also higher Q values, which indi- 
cates that the linear bias models are not enough to de- 
scribe the 3PCF distribution in comparison of various 
color samples. The nonlinear bias will be of importance 
for Q in the color distribution. The red galaxies display 
stronger shape dependence than blue galaxies in the low- 
mass samples and on large scales, which means that the 
red galaxies are more affected by the large-scale struc- 
tures. 

We use the projected reduced 3PCF to study the effect 
of redshift-space distortion in the dependence on stellar 
mass and color. We find that the redshift-space distor- 
tion would reduce the dependence on the galaxy proper- 
ties. Since the projected-space Qp shows weaker shape 
dependence than the redshift-space Qs, we conclude that 
the redshift-space distortion will increase the shape de- 
pendence of Q. On large scales, the redshift distortion 
will have minimal effects on Q, so Qs and Qp converge 
on large scales. But the large-scale structure also signif- 



icantly affect the measurement of the 3PCF. The mea- 
sured Qp suffers from larger shot noise fluctuation than 
Q.. 

These measurements of the three-point correlation 
function can be compared with the dark matter simula- 
tions to constrain galaxy bias, and they can also be used 
to constrain the galaxy formation and evolution models 
in the mock galaxy samples, which will be explored in 
future work. 
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